% Include with \input{childrensBook.tex}

%\begin{comment}
%\documentclass[a4paper, fullpage]{article}
%\usepackage{graphicx}
%\usepackage{pdfpages}
%\usepackage{float}
%\usepackage[all]{xy}

%\setlength{\parindent}{0in}

%\begin{document}
%\title{Project in Artificial Intelligence TIN171}
%\author{Sebastian Johansson\\
%850317-4834 \\
%sebjoh@student.chalmers.se}
%\date{\today}

%\maketitle
%\end{comment}
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%

The idea is to have a program learn to associate words with visual objects by
having it read books for young children.\\

For this we need four basic components:
\begin{itemize}
\item Object-detection. A component that takes an image as imput and outputs
images containg the objects shown in the original image. As an option, we
could do this part manually. (We could maybe use some part of open-cv for
this).
\item Image-recognition. A component that given a new image with an object,
compares it with allready known objects and deduces which object it is. Or
classify it as an unknown object. (We could maybe use some part of open-cv or
Vison Toolkit developed by Numenta for this.)
\item Natural language processing. A component that can read simple texts and extract
the words representing objects.
\item A reasoning system. A component that given the objects in one image, and
the words representing objects, compares them with material from other pages
in the book and deduce which words that (probably) should be combined with
which objects. (Could we use some sort of fuzzy-logic system for this?)
\end{itemize}

So in the end, reading one book shoul result in a collection of sample images
representing objects in the book and name tag for each object. Example:

\begin{figure}[H]
    \begin{center}
    \includegraphics[width=0.75\textwidth]{CalvinHobbes.jpg}
    \caption{Page 1: This is Calvin and Hobbes.}
    \end{center}
\end{figure}

Analyzing this, we get two objects (or possibly some more) and two words
\emph{Calvin} and \emph{Hobbes}.

\begin{figure}[H]
    \begin{center}
    \includegraphics[width=0.75\textwidth]{calvin.jpg}
    \caption{Page 2: Calvin has a ball.}
    \end{center}
\end{figure}

Now, given page 1 and 2, we could deduce what object is Calvin, what object is
the ball and what object is Hobbes.\\

A really ambitious goal would be to have the program read a book and then show
it an image of an object in the book - a ball for instance. And ask it what
the image represents.

%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
% \end{document}

